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BACKGROUND OF THE INVENTION 



1. FIELD OF INVENTION 

[0001] The invention relates generally to measuring and Improving 
business performance, and more specifically to apparatuses and methods used 
to measure and improve contact center agent performance. 

2. ART BACKGROUND 

[0002] Businesses interact with a plethora of customers on a daily basis 
across the world, in order to conduct commerce in the modern age. A given 
business experiences its own universe of customer interactions or transactions 
("interactions" and "transactions" are used synonymously herein), which are 
necessary to maintaining a healthy and thriving state of business-customer 
relationships; such a state of business-customer relationships is necessary and 
vital to ensure the success of the business. 

[0003] In order to interface with the customers, businesses have adopted 
the contact center model to provide personal service to the customers via teams 
of agents that engage in interactions with customers. Customers commonly use 
the telephone and email as a means of contacting a business, such a center 
staffed with agents to field calls from customers is commonly called a call center. 
[0004] Call centers can vary in size from small units containing several 
agents to large units containing teams of agents numbering into the hundreds or 
even thousands. Often the call centers are large and require significant 



062403.P001 



3 



resources to staff, manage, and train the agents that comprise the call center. 
Call centers are managed by one or more managers whose jobs include both 
solving the complex customer problem, which presents questions beyond the 
authority of the agent to resolve, to supervising the agent's interaction with the 
customers so that the quality of service provided to the customers can be 
monitored and hopefully improved. 

[0005] Accessing the quality of service provided to the customers by the 
call center agents has grown increasingly more difficult as call centers have 
increased in size. An agent handles many calls and/or emails a day; however, 
only a small fraction of the calls and/or emails fielded by an agent are ever 
monitored by a call center supervisor. Typically, call center agent perfonnance is 
measured only once a week, at an agent level. This low frequency rate of 
monitoring does not provide an adequate measure of the agent's performance 
and the quality of service provided to the customer, U.S. Patent No. 5,535,256 
to Maioney et al. provides a tool to the call center supervisor that is aimed at 
automating the monitoring process within the constraints of a call center 
supervisor's ability to address the variety of tasks that the supervisor is assigned 
to do. However, the call center supervisor cannot sample the agent's calls 
frequently enough and provide the necessary feedback to the agent that is 
required to increase the quality of sen/ice provided to the customers. Neither 
can the call center supervisor increase the sales rate of the agents or the overall 
return on investment with respect to the call center. 
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[0006] What is needed are affordable processes and systems for business 
contact centers that are scalable to any size business which can also improve 
the performance of the contact center agents, their business processes, and 
their customer interactions. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



[0007] The invention may best be understood by referring to the following 
description and accompanying drawings that are used to illustrate embodiments 
of the invention. The invention is illustrated by way of example in the 
embodiments and is not limited in the figures of the accompanying drawings, in 
which like references indicate similar elements. 

[0008] Figure 1 illustrates a system architecture for business customer- 
contact analysis and improvement, employing wage attenuation, according to 
one embodiment of the invention. 

[0009] Figure 2A illustrates one embodiment of high frequency contact 
center interaction monitoring. 

[0010] Figure 2B displays one embodiment of a score sheet. 

[001 1] Figure 2C contains a continuation of the score sheet from Figure 

28. 

[0012] Figure 3A illustrates a flow diagram for interaction analysis and 
feedback according to one embodiment of the invention. 
[0013] Figure 3B is a training flow chart according to one embodiment of 
the invention. 

[0014] Figure 3C illustrates an integration of calibration types, according 
to one embodiment of the invention. 

[0015] Figure 3D is one embodiment of an Internet based agent level 
evaluation feedback tool. 
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[0016] Figure 4 illustrates real-time high frequency contact center 
monitoring according to one embodiment of the invention. 
[0017] Figure 6 illustrates a flow diagram for interaction analysis 
corresponding to Figure 4. 

[0018] Figure 6 illustrates a flow diagram employing a high frequency data 
base, according to one embodiment of the invention. 

[0019] Figure 7 illustrates an example of increased profitability according 
to one embodiment of the invention. 
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DETAILED DESCRIPTION 



[0020] In the following detailed description of embodiments of the 
invention, reference is made to the accompanying drawings in which like 
references indicate similar elements, and In which is shown by way of illustration, 
specific embodiments in which the invention may be practiced. These 
embodiments are described in sufficient detail to enable those of ordinary skill In 
the art to practice the invention. In other instances, well-known circuits, 
stmctures, and techniques have not been shown In detail in order not to obscure 
the understanding of this description. The following detailed description is, 
therefore, not to be taken in a limiting sense, and the scope of the invention is 
defined only by the appended claims. 

[0021] Apparatuses and methods are described to allow businesses to 
increase profitability by monitoring a business's contact center processes at high 
frequency with special feedback provided to the business's contact center. High 
frequency monitoring is achieved by employing geographic wage attenuation 
coupled with language fluency between the agent-customer contact and the 
analyst. 

[0022] Figure 1 illustrates a system architecture for business customer- 
contact analysis and improvement, employing wage attenuation, according to 
one embodiment of the invention. With reference to Figure 1, geographic wage 
attenuation is shown generally at 100. A first geographic area 1 is indicated at 
102, wherein wages are high relative to a second geographic area 2 indicated 
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generally at 104. Geographic area 102 and geographic area 104 are connected 
by a communication network that allows the transmission of information between 
the two geographic areas. Both geographic areas share at least one language in 
common and a differential in wages between the first and second geographic 
areas. For example, in one embodiment, geographic area 102 corresponds to 
the United States (US), geographic area 104 corresponds to India and the 
language shared in common is English. For a similar job. wages are higher in 
the US than wages are for the similar job in India; thereby establishing 
geographic wage attenuation between the two distinct geographic areas. 
[0023] As used in this description, sharing a language in common does 
not imply that the language is shared across the whole population of the 
geographical area. It is sufficient that a number of people, however small, can 
be found within the geographical area where the analysis of the customer 
contact is performed, which shares the language in common with a number of 
people in the second geographical area. No constraint Is placed on the number 
of people in either geographical area. 

[0024] In one example, wages in the US are $20 US per hour and wages 
in India can be $4 US per hour for the same type of job. Wage attenuation will 
be defined as follows: wage attenuation equals the wages in geographic area 2 
divided by the wages In geographic area 1 . In the previous example the wage 
attenuation (.2) is arrived at by dividing $4 by $20: .2 = (4/20). Geographic area 
1 or the first geographic area is the area where the business's customers are 
located and possibly the business's agents are located; however, all of the 
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business's customers and/or agents need not be located in geographic area 1 . 
Geographic area 2 or the second geographic area is the area where the analysis 
of the customer interaction or transaction ("interaction" and "transaction" are 
used synonymously herein) occurs. 

[0025] In another embodiment, geographic.area 102 can correspond to 
Canada, England or Australia. Some examples of geographic area 104 can 
include, but are not limited to. countries such as Botswana, Kenya, Liberia, 
Nigeria, South Africa, Swaziland, Tanzania, the Philippines, and Fiji, where the 
language in common is English. In another embodiment, geographic area 102 
could correspond to France. Some examples of geographic area 104 can 
include, but are not limited to countries such as Algeria, Rwanda, Senegal, and 
Haiti, where the language in common is French. In another embodiment, 
geographic area 102 could correspond to the United States. Some examples of 
geographic area 104 can include, but are not limited to countries such as, 
Argentina, Dominican Republic, Ecuador, El Salvador, Equatorial Guinea, 
Republic of the Congo, Mexico, Nicaragua, Panama, and Uruguay, where the 
language in common is Spanish. No limitation is placed on the particular 
geographic areas comprising the geographic wage attenuator or the language 
shared in common between the two geographic areas. In one or more 
embodiments, of the invention, a geographic area is a general area and need not 
be confined to the boundaries of specific countries as named herein. The 
geographic area can be a general region and can include a part of a country or a 
part of more than one country. 
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[0026] Located within geographic area 1 02 are one or more businesses 
having teams of agents interacting with customers of the business, indicated 
generally at 106, Many types of agent-customer interactions can be analyzed 
with the apparatuses and methods taught herein. Such examples include, but 
are not limited to; inbound sales calls (to make and change reservations and sell 
tickets for travel on airlines, trains, boats, etc.) e-mails, trouble tickets, etc. Other 
interactions include, technical support calls subsequent to the purchase of a 
product or service, including warranty support issues, etc. Calls to rent products 
or services, such as automobiles, clothing, etc. The present invention is not 
limited by the type of agent-customer interaction engaged in by a business. The 
interactions can consist of a telephone call, email, data or any combination 
thereof. 

[0027] The customers need not be confined to geographic area 102 but 
can be located in a variety of geographic areas other than 102 and 104. The 
agent/customer interaction data flow 110 proceeds from geographic area 102 to 
geographic area 104 by means of a communication network. The 
agent/customer interaction data flow is analyzed at high frequency at 108 in 
geographic area 104. Analysts located in geographic area 104 analyze an 
agent's customer interactions at a rate of at least one interaction per agent per 
day to create a high frequency analysis data base 1 14. Special uses of the high 
frequency analysis data base will be described in more detail below with 
reference to the figures that follow. 
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[0028] Feedback 1 1 2 flows from geographic area 1 04 to geographic area 
102 and is communicated to the business's agents. Feedback 112 comprises 
the results of scoring the agent's interaction with a customer and is used to 
improve the agent's perfonnance; thereby, increasing the business's profitability. 
Feedback 112 will be described more fully below with reference to the figures 
that follow. 

[0029] The frequency at which an agent's interactions are analyzed can be 
controlled by either the business within 106 or by the analysts within 108. 
Typically, the agent's interactions with customers will be analyzed at 
approximately a rate of one interaction per agent per day, indicated by X or a 
statistically relevant sample size based on the requirements of a business. In 
some embodiments, the analysis rate can be greater and will be indicated by a 
number preceding the X. For example, analyzing 4 Interactions per agent per 
day would be indicated by 4X. 

[0030] Figure 2A illustrates one embodiment of high frequency contact 
center interaction monitoring generally shown at 200. With reference to Figure 
2A, geographic area 102 and geographic area 104 are connected by 
communication network 202. Communications network 202 can be the Internet 
or a special purpose network configured to facilitate communications between 
the geographic areas in order to practice the Invention. In one embodiment, 
communication network 202 can be a combination of general networks such as a 
business's intranet, the Internet, and special purpose networks configured to 
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facilitate the practice of the invention. Communication networl< 202 can also 
Include one or more satellites indicated by 204. 

[0031] Within geographic area 102, one or more businesses engage in 
activity that requires interactions between agents and customers of the business. 
The interactions can take the form of telephone calls or emails. For simplicity 
within this description, but without loss of generality to multiple businesses, the 
discussion within the remainder of this detailed description of embodiments of 
the invention will be limited to describing a single business. It will be recognized 
that the teachings herein are scalable to businesses of any size and to a plurality 
of businesses without limit on the number of businesses. 
[0032] A business's customer contact center is indicated by agent team 
210. Agent team 210 can contain a general number of agents as indicated in 
Figure 2A within geographic area 102. The agent team need not all be located 
within the same geographic area. For simplicity, only two geographic areas have 
been presented herein, 102 and 104. Similarly, not all of the business's 
customers need to be located within geographic area 102. The customers can 
be located in any geographic area and need not be limited to the two geographic 
areas shown, 102 and 104. In one or more embodiments, other communications 
networks (not shown) provide communications between customers in other 
geographic areas and the agent team 210 as well as providing communications 
between agent teams located in different geographic areas or an agent team 
distributed between different geographic areas. 
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[0033] Workstations for three agents are shown in Figure 2A; however, a 
general number of workstations and agents is anticipated. A first agent's 
workstation consists of computer 212 and telephone 214. Calls and 
corresponding customer account information, for example, are combined at 216 
and stored on client's server 240. Similarly, a second agent's computer, 
indicated at 222 and telephone 224 are combined at 226 and routed to client's 
server 240. Client's intranet 238 can provide a data network within the 
business's customer contact center operation. A general maximum number of 
workstations is indicated by computer 232, and telephone 234, which are 
combined at 236 and coupled with client's server 240 through intranet 238. 
Without limitation to the teachings presented herein, intranet 238 can be a wired 
network, for example an Ethernet line, a wireless network, for example a network 
according to the 802.11(a) or 802.1 1(b) standard, or any other suitable 
communications network. 

[0034] In one embodiment, all customer interactions, including voice and 
pertinent data are stored on the client's server 240 and/or on an analysis server 
258. The analysis server one (1) at 258 can provide a backup function to the 
client's server 240 or replace the client's server 240 according to a particular 
hardware configuration employed with a particular business. In other 
embodiments, the agent/customer recording function can be provided by 
commercially available systems such as systems from NICE® or WITNESS® 
which would provide an output to the analysis server two (2) at 256 making these 
data available for analysis in geographic area 104 by an analysis team 250. 
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Various protocols can be used to provide these data such as voice over Internet 
protocol (VoIP). Servers, such as 240 and 258, and any other device used to 
store the storable representations can be any suitable device configured to store 
data; examples of which include, but are not limited to, magnetic and optical disk 
drives, solid state memory, tape drives, etc. 

[0035] Analysis team 250 is comprised of a team of individuals who are 
fluent In the language that the agents and customers converse in. Each analyst 
has a workstation as indicated by workstation 252 up to a general number of 
analyst workstations 254 which receive data from analysis server 2 Indicated at 
256. An analyst's workstation is typically configured as a desktop computer, 
which has a data display device such as a monitor, flat panel display, etc. The 
workstation is typically configured with one or more data input devices such as a 
pointing device, a computer mouse, a touch pad, a keyboard, a voice activated 
interface including a microphone, local storage (which can also be used to store 
the storable representations of interactions), etc. The workstation need not be 
confined to a desktop computer configuration; a laptop computer, a handheld 
computer, and a wearable computer are all alternative configurations for the 
workstation. In one embodiment, there will be fewer analyst workstations than 
agent workstations since it is generally not required to analyze every call that the 
agent makes. However, it is possible to employ a number of analysts sufficient 
to analyze every interaction that is made by every agent with every customer. In 
one embodiment, acceptable results are achieved with two to three analysts 
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monitoring 50 to 70 agents interacting with customers in tlie airiine reservation 
industry. 

[0036] In one embodiment, the analysts review and evaluate 
agent/customer interactions to ensure that the agents have met quality of service 
criteria established for a particular business. In one embodiment, the evaluation 
process includes the areas of core skills, soft skills, selling skills, and specific 
know how. The analysts check core skills by analyzing the agent's method and 
competence in; answering the phone and greeting the customer; getting the 
order in the system; answering basic questions; and comprehension of a request 
made via email. Some reporting metrics used for report generation include the 
average call handle time and spelling and grammar used accurately during the 
interaction with the customer. . Soft skills are checked by analyzing whether the 
agent's greetings are scripted; detemiining how "canned" the email responses 
are; determining whether the agent can handle an irate customer under 
pressure; and analyzing the agent's knowledge of when to engage the agent's 
supervisor to resolve the call. Some reporting metrics used for report 
generation for soft skills include whether the customer's issue was resolved with 
the first call, this includes metrics related to specific know how (i.e., technical 
support/knowledge), and how many repeat emails were required to resolve the 
customer's issue. Analyzing selling skills involves ranking the agent's ability to; 
recommend additional products (cross-sell); sell more of the product under 
discussion by successfully understanding the tone and Intonation of the 
customer during the Interaction; and comprehension of the products and 
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services. Some reporting metrics used in report generation for selling skills 
include measurements of the agent's up-sell and cross-sell perfomiance. In 
some embodiments, reporting can include scoring compliance with regulations 
such as the Telephone Consumer Protection Act (TCPA) or other regulations. 
[0037] For example, if the customer interaction consisted of an inbound 
sales call where a customer called to place an order for a product, such as a 
camera, some of the criteria the analyst will be looking for are whether the agent 
has opened the call properly, acted courteously, attempted to up-sell (i.e., sell a 
higher end camera), cross-sell and add-on-sell (i.e., selling film and a camera 
accessory bag with the original camera order) the customer, and checking to 
determine if the agent was knowledgeable enough to meet the demands of the 
sale in order to accomplish the up-sell or cross-sell (e.g., could the agent explain 
the features and benefits and answer technical questions related to the product). 
Other criteria are employed as are appropriate for a particular industry. For 
example, in one embodiment, analysts will grade the Interactions according to 
established quality monitoring criteria for a particular industry sector or a 
particular business. In one embodiment, an agent's performance is sampled at 
least once a day by the analysts generating report data and agent feedback. 
Report data is stored in data base 1 14 for later use and a portion thereof is 
tailored for the business and the business's agents at 108. Feedback is 
provided to the business and the agents at 260. 

[0038] Wages earned by workers in geographic area 104 are lower than 
wages earned by workers in geographic area 102; thereby, creating geographic 
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wage attenuation between the respective geographic areas. High frequency 
analysis of the agents' quality of service, provided to customer contacts, can be 
achieved while simultaneously increasing the business's profits. In one or more 
embodiments, a debit or a credit will be transferred in exchange for services 
provided by the analysts. An example of a debit is an invoice or a bill to show 
what is owed and an example of a credit is payment In the form of valuable 
consideration. 

[0039] Figure 2B and Figure 2C display an embodiment of a score sheet 
that can be used by an analyst to evaluate and score a transaction between an 
agent and a customer. With reference to Figure 2B, a score sheet is shown 
generally at 260a and continues onto Figure 2C at 260b. Score sheet 260a can 
be provided in many different ways, the embodiment depicted within the figures 
is but one of the many different formats that can be used to evaluate an 
agent/customer transaction. Score sheet 260a/260b can be configured as a 
software application that is displayed on the analyst's workstation, such as 
workstation 252 in Figure 2A. Alternatively, score sheet 260a/260b could be 
displayed on any data display configured to interact with the flow of data 
emanating from geographic area 102 (Figure 2A) which is accessible to analysts 
in geographic area 104 (Figure 2A). 

[0040] An analyst evaluates a transaction between an agent and a 
customer by replaying or reviewing a stored representation of the transaction 
and then assigning a score to the components of the agent/customer interaction 
based upon an evaluation of the transaction. In one embodiment, the evaluation 
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proceeds with the analyst replaying a stored representation of a telephone call. 
In another embodiment, the evaluation proceeds when the analyst reviews an 
email exchange between an agent and a customer. In other embodiments, the 
interaction can consist of a combination telephone call and email exchange 
between the agent and the customer or the interaction can be embodied In other 
formats. In the example shown in Figure 2B and Figure 2C, an evaluation 
consists of scoring a telephone interaction between an agent and a customer. 
The Interaction can be broken down into the major categories of "Call Opening" 
264, "Customer Service Skills" 272, "Call Closing" 280, "Knowledge, Accuracy 
and Resolution" 282, "Call management" 284, "Sales" 286, "Comments 
Summary" 288, and "Even better tips" 290. 

[0041] In the embodiment shown, "Call Opening" 264 has subcategories 
that are scored individually by the analyst. For example, the degree to which the 
agent used the proper greeting is assigned a score by the analysts at location 
266. The score can be assigned using any suitable grading scale such as a 
numeric scale, an alphabetical scale or other scale created to rank the agent's 
performance. In one embodiment, a numeric scale can be used having a range 
of values from 1 to 10, where 1 indicates minimum compliance and 10 indicates 
maximum compliance. Other ranges can be used, such as 1 to 5; no limitation is 
implied by the ranges given in this description. Another subcategory, "Asked for 
Transaction ID," is assigned a score after evaluation In location 268. The scoring 
for item 268 can be according to a two state yes/no score rather than a score 
that comprises more than two states. The other subcategories are scored and 
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the analyst can enter comments pertinent to the category or subcategory in field 
270. 

[0042] The other major categories 272, 280, 282, 284, and 286 are scored 
in a similar way, whereby the analyst assigns scores to the subcategories and 
comments as needed. A total score (not shown), representing the evaluation of 
the interaction, can be assigned either automatically by a scoring algorithm, as 
part of a computer based application, or by the analyst. 
[0043] With reference to Figure 2C, fields for "Comments Summary" 288 
and "Even better tips" 290 are provided. The analyst can provide a comment 
summary in field 288, if it is deemed necessary, after completing the evaluation. 
Additionally, the analyst can provide "Even better tips" In field 290. In one 
embodiment, "Even better tips" can include one or more elements of an 
Interaction that the agent performed well and one or more elements of the 
interaction that the agent could perform even better, with a suggestion from the 
analyst explaining how the agent might achieve the increased performance. In 
another embodiment, the "Comments Summary" 288 can include one or more 
elements that the agent performed well and the "Even better tips" 290 can 
include one or more elements that the agent could perform even better. 
[0044] In one embodiment, the score sheet can serve as a training aid to 
the analyst by apprising the analyst of new infomnation pertinent to the 
business's activity or reminding the analyst of infomriation that is of particular 
importance. For example, in Figure 2B, field 262 can be implemented as a 
scrolling update bar in a window on a data display for the benefit of the analyst; 
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thereby, displaying information as shown in the figure. Training the analysts will 
be described more completely below in conjunction with Figure 3B. 
[0045] Figure 3A illustrates a flow diagram for interaction analysis and 
feedback according to one embodiment, generally shown at 108. With reference 
to Figure 3A, analysts review and evaluate transactions between agents and 
customers at 300. Such evaluations can be performed according to the 
description associated with Figure 2B and Figure 2C. Initially, a calibration loop 
302-304-306 provides uniformity in scoring an agent's performance by submitting 
the same agent's data to the entire team of analysts multiple times and reviewing 
the scored results between the analysts until the variation between analysts' 
scores of the same agent's data is within acceptable limits (internal calibration). 
The same calibration process follows between the team of analysts and the 
agent's specific team supervisor and/or manager. The agent, the agent's team 
supervisor or the agent's manager can be referred to as the client, in such a 
case, calibrating the analysts to one or more of these entities associated with the 
particular business can be referred to as a "client calibration." Acceptable 
calibration limits will be determined by the requirements of particular businesses; 
however, in one embodiment, a deviation of five percent (5%) between individual 
analyst's agent-scores (internal calibration) is one example of an acceptable 
level of uniformity and a deviation of five percent (5%) during a client calibration 
is one example of an acceptable level of uniformity. 
[0046] Calibration of the interaction evaluation process can also be 
performed by using Anonymous Transaction Simulations (ATS). During an ATS 
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calibration, a common transaction is delivered to all or a specific group of 
analysts to score. The scoring can also Include the analysts adding their 
particular even better tips. During the ATS calibration, the analysts are unaware 
that the transaction is a common replicate. The common transaction need not 
be an actual transaction, but it can be a transaction designed to test a particular 
category or subcategory of a transaction. The agent's manager, supervisor or 
the analyst's supen/isor or subject matter expert (described in conjunction with 
Figure 3B) can use the ATS to test specific training updates, issues or unique 
customer interaction scenarios. 

[0047] Further calibration can be provided by the analyst's supervisor or 
subject matter expert in the fomi of a random quality audit. In one embodiment, 
during a random quality audit, the analyst's evaluation(s) of one or more 
agent/customer interactions are evaluated by the analyst's supervisor, subject 
matter expert, or equivalent manager. 

[0048] As previously described in conjunction with Figure 2A, agent teams 
(sometimes referred to as customer contact centers or call centers) can be 
located in different geographic areas or at different locations within a single 
geographic area. Therefore, a business can have a plurality of customer contact 
centers across which the previously described calibration processes can be 
perfonned. One or more of these customer contact centers can be located 
intemal to the business and one or more of these customer contact centers can 
be located external to the business. The calibration processes described herein 
are equally applicable to a mixture of internal and external customer contact 
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centers. An example of an internal customer contact center is, but is not limited 
to, a center operated under the control of the business. An example of an 
external customer contact center is, but is not limited to, a customer contact 
center that is operated under limited control or influence by the business, such 
as by contractors or a contractor provided service via an external customer 
contact center. 

[0049] The transaction score 304 and even better feedback 302 are sent 
to the business at 308. Feedback is provided to the respective agents at 310. 
Agents can respond to the feedback at 312 and the business provides input at 
314. Depending on the agent's response and the input from the business, 
recalibration of the analysts may be required at 316. The process described in 
Figure 3A is flexible and accommodates agents' responses and the contact 
center management's response by customizing scoring as needed. In one 
embodiment, the even better feedback 302 includes informing an agent of an 
agent performance element that was well performed, and informing the agent of 
a performance element that could be performed even better than the way the 
agent presently perfonns the element. Additionally, the even better feedback 
302 can include training tips, provided as appropriate to contact center 
management or the agent based on analyzing the agent's interaction with 
customers. 

[0050] In various embodiments, the invention can be applied to suit the 
needs of any business. Specific knowledge about the procedures, processes, 
products, and/or services of any business can be assimilated by the analysts 
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during training; thereby, allowing the analysts to become an extension of the 
business's customer contact center. Figure 3B displays a training flow chart at 
320, according to one embodiment of the Invention. With reference to Figure 
3B, "Business's training criteria" 322 includes information relevant to the 
business that needs to be considered In the context of evaluating an 
agent/customer interaction. Information 322 flows as needed to a subject matter 
expert 324. The subject matter expert 324 ensures that the pertinent 
information, 322, is disseminated to and assimilated by the analysts as needed. 
As indicated previously in conjunction with Figure 2B at 262, the subject matter 
expert can provide training updates to the analysts. The subject matter expert 
effectively functions as a knowledge hub, maintaining a knowledge base and 
communicating this knowledge, comprising product, service, process, updates, 
etc. to the analysts. 

[0051] In one or more embodiments, analysts receive training in block 
326; the training is based on the requirements that are compiled by the subject 
matter expert in 324. In one embodiment, an analyst's training includes reading 
an update when the analyst logs onto a workstation, such as 252 in Figure 2A, 
before the analyst can proceed to evaluate agent/customer interactions. The 
analyst can be required to check a confirmation box before being allowed to 
proceed to evaluations. 

[0052] The analysts' knowledge can be improved by the subject matter 
expert, such improvement directly enhances client calibration results; thereby 
minimizing discrepancies between an analyst's score and the score that an 
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agent's manager would give for the same interaction. Internal calibration is also 
improved by increasing the analyst's knowledge of information 322 and other 
training criteria 321 as is appropriate. The subject matter expert can improve the 
analysts' knowledge by creating knowledge testing programs. In one 
embodiment, test questions are compiled by the subject matter expert and 
passing criteria are set at 328. If an analyst meets the passing criteria by 
achieving a passing grade on the knowledge test then that analyst can proceed 
to perform evaluations of interactions. Those interactions will continue to be the 
subject of ongoing calibration as indicated at 332. Ongoing calibration will be 
described more fully in conjunction with Figure SC. If the analyst does not meet 
the passing criteria at 328 then further training is indicated by path 330. 
[0053] At times it may be desirable to communicate urgent updates to the 
analysts in the form of a verbal communication from the subject matter expert, 
some other person or an automated system. In such a case, a transaction hold 
can be administered, which would prevent the analysts from evaluating 
transactions until the analysts are addressed and the hold is removed. 
[0054] In some embodiments, the training described herein with respect to 
the analysts can be directed to the business's agents. This training can be 
administered in the form of training updates, quizzes, or online exercises. Agent 
training can be adapted to the specific needs of a particular business. 
[0055] In other embodiments, other training criteria 321 , such as 
knowledge amassed from services provided to a first business can be directed 
toward improving the performance of a second business. Other training criteria 
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321 can include data accumulated from the high frequency evaluations of the 
agent/customer interactions as well as the training criteria and knowledge 
assembled by the subject matter expert or other personnel or automated system. 
[0056] Various types of calibration were described in conjunction with 
Figure 3A, these individual types of calibration can be combined and applied to 
both minimize the length of time needed to train and deploy a team of analysts to 
commence evaluation of a business's customer transactions, and to minimize 
the length of time required for a business's agent team to gain operational 
competency with respect to the subject matter of the business. 
[0057] Seasonal or limited duration agents, such as non-full time 
employees or contractors, present training problems for many businesses since 
these agents are typically hired for a short period of time and the agents must be 
trained in an even shorter period of time. For a business to enjoy a productive 
period of working time from these agents, the agents must be trained in a time 
period that is shorter than the duration of the season or time period for which 
they were hired to work in. Therefore, it is desirable to shorten the training 
period of the agents as much as possible. 

[0058] In one embodiment, of the invention, a calibration process for a 
business's agents Is described with the aid of Figure 3C. In this embodiment, 
the agents can be short duration or seasonal employees or contractors. No 
limitation is implied by the type of work relationship that exists between the 
person (agent) and the business, e.g., agent, employee, or contractor. With 
reference to Figure 3C, a table 338 displays a calibration timeline, where time 
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proceeds down the rows of the table 338, e.g., 342, 344, 346, and 348. The 
types of calibration are displayed as columns in table 338, e.g., 352, 354. 356. 
and 358. 

[0059] In this embodiment, the analysts are trained for two (2) weeks as 
described in conjunction with Figure 3B; thereby, allowing the analysts to 
assimilate the pertinent information from sources 322 and/or 321 (Figure 3A). 
This two week training period is indicated at row 340, column 350 in Figure SC. 
Week one consists of a nesting period, row 342, where one hour of client 
calibration 352 and one hour of intemal calibration 354 is undertaken daily to 
ensure that the analysts produce evaluations that are consistent with evaluations 
that the client would produce and that the analysts' evaluations are internally 
consistent. Also within the first week, Anonymous Transactions Simulation 
(ATS) are administered at the rate of one (1) transaction per agent per day at 
356. The analysts' evaluations are audited within column 358 for quality at the 
rate of twenty (20) percent of the total evaluations performed to ensure rapid 
convergence of the analysts' evaluations and to spot problems that might need 
to be addressed early in the calibration process. 

[0060] During week two (2), indicated by row 344, the client calibration 
352 is reduced to three (3) hours a week and the internal calibration 354 is 
reduced to three (3) hours a week. During this second week, the ATS rate 356 
can be decreased to two (2) transactions per agent per week and the quality 
audit 358 can be decreased to ten (10) percent of total transactions evaluated. 
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[0061] During week three (3), indicated by row 346, the client calibration 
352 is reduced to two (2) hours a week and the internal calibration 354 is 
reduced to two (2) hours a week. During this second week, the ATS rate 356 
can be decreased to one (1) transaction per agent per week and the quality audit 
358 can be decreased to five (5) percent of total transactions evaluated. 
Presumably, the seasonal employees of the business (agents) are learning the 
material required for their seasonal job with the passage of time and the 
frequency of the types of calibration administered can be reduced as the 
passage of the successive weeks Indicates. 

[0062] In the fourth and subsequent weeks, indicated by row 348, ongoing 
calibration will consist of two hours of client calibration 352 a week, two (2) hours 
of internal calibration 354 a week; one (1) ATS transaction per agent per week 
356; and a five (5) percent quality audit 358 of transactions evaluated. 
[0063] In the previous description, durations of the various types of 
calibration were given as examples; no limitation is implied by these durations 
such as numbers of weeks, hours, percentages, etc. These quantities are 
Illustrative of one embodiment. Other time periods and frequencies are possible 
and appropriate to meet the particular needs of specific businesses and 
business objectives. 

[0064] In one or more embodiments of the invention, communication 
between agents, analysts, support personnel (subject matter experts), etc., and 
the respective managers Is accomplished with the aid of the networks described 
in conjunction with the previous figures. Components of an integrated software 
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application that incorporates the previously described functionality is illustrated in 
Figure 3D, according to one embodiment of the invention. 
[0065] Figure 3D is one embodiment of an Internet based agent level 
evaluation feedback tool, shown generally at 360. With reference to Figure 3D, 
analyst evaluations are indicated within block 362. The analysts receive 
transactions and the appropriate evaluation criteria based on a particular 
business and the pertinent product/service knowledge. The evaluations of the 
agent/customer interactions involve monitoring the transactions at an agent level, 
scoring evaluations, reporting on trends and opportunity areas for the business, 
providing even better tips, compliance monitoring, and other feedback as needed 
by the particular business, as well as making this information available to the 
business. 

[0066] As previously described, these evaluations 362 are the subject of 
different types of calibration; internal calibration, client calibration. Anonymous 
Transaction Simulations (ATS), and quality audits, all indicated generally at 364. 
These calibrations raise the performance level of the analysts and the businesses 
agents as previously described. 

[0067] In one embodiment, an Analyst's Console 366 provides the analyst 
with project updates, is used during calibration, displays quality and productivity 
scores, can be used for knowledge testing and other communications from, for 
example, the subject matter expert or others as previously described. 
[0068] In one embodiment, the Supervisor's Console 368 provides the 
analysts' supervisor with data on one or more of the particular campaigns that 
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can be in progress for one or more businesses, whicli are being supported by 
the analysts as described herein. Supervisor's Console 368 can provide 
information to the supervisor, such as but not limited to; real-time campaign 
results, project updates, agent team and/or agent level reporting, subject matter 
expert (SME) feedback, transaction evaluations, etc. 
[0069] In one embodiment, a SME/Management Console 370 can be 
used to provide a reporting suite for analysis, track training updates, provide 
training suggestions, maintain a knowledge base, etc. 
[0070] In one embodiment, information is divided between the analyst 
side, as described above, and the client (business) side. The client side can 
include a Client Agent Console 372, which can provide feedback to the agents 
on items such as the agent's customer interactions that were evaluated and the 
associated scores, comments, even better feedback tips, etc. Client Agent 
Console 372 can also include agent improvement results or lack of improvement, 
previous transactions identified for agent self-awareness, etc. Client Agent 
Console 372 can also provide the agent with training updates, quizzes, and on- 
line exercises as needed to suit a particular buslness's need. 
[0071] In one embodiment, a Client Supervisor Console 374 can provide 
data such as, agent level scores, top defects in agent performance, stack 
ranking of agents' performance, agent team reports, trend analysis, individual 
and agent team based improvements, training suggestions, and improvement 
margins. 
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[0072] In one embodiment, a Client Manager & Executive Console 376 
can include agent and agent team trends, stack ranking, top defects, training and 
process improvement suggestions, agent team perfonnance Improvement 
margins, etc. 

[0073] In general, the consoles described in relation to Figure 3D can be 
tailored to the needs of any business that requires customer interactions. The 
description of Infonnatlon available on the various consoles of Figure 3D is 
illustrative of one or more embodiments of the invention and Is not to be taken in 
a limiting sense. Various other compilations of Information and functionality will 
be apparent to those of skill in the art from the teachings presented herein. 
[0074] Figure 4 illustrates real-time high frequency contact center 
monitoring according to one embodiment of the invention, generally shown at 
400. A business's customer contact center is indicated by agent team 410 within 
geographic area 102. Not all of the business's customers need to be located 
within geographic area 102. The customers can be located in any geographic 
area and need not be limited to the two geographic areas shown, 102 and 104. 
Agent team 410 can contain a general number of agents as indicated In Figure 4 
within geographic area 102. The agent team need not all be located within the 
same geographic area. For simplicity, only two geographic areas have been 
presented herein, 102 and 104. Other communications networks (not shown) 
provide communications between customers in other geographic areas and the 
agent team 210 as well as providing communications between agent teams 
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located in different geographic areas or an agent teann distributed between 
different geographic areas. 

[0075] A first agent's workstation consists of computer 412 and telephone 
414. Calls and corresponding customer account information, for example, are 
combined at 416 and are available to conference via 440 to the analysis team 
450 in the second geographic area 104. Similarly, a second agent's computer 
Indicated at 422 and telephone 424 are combined at 426 and routed to call 
conferencer 440. A general maximum number of workstations is indicated by 
computer 432. Computer 432 and telephone 434 are combined at 436 and 
routed to 440. 

[0076] Communications network 202 couples geographic area 1 02 with 
geographic area 104 allowing information to flow between the respective areas. 
Communications network 202 can include one or more satellites as indicated by 
204. Communications network 202 facilitates the flow of agent/customer calls 
from call conferencer 440 in geographic area 102 to switch 456 in geographic 
area 104. Call conferencer 440 can include a device such as an automatic call 
distributor (ACD). 

[0077] Analysis team 460 is comprised of analysts and analyst 
workstations 452 up to a general number indicated by 454. Agent/customer calls 
are distributed to analysts through switch 456 providing real-time monitoring by 
the analysts. Near real-time high frequency interaction analysis 460 provides the 
agent with nearly immediate feedback 470 on his or her perfomnance during the 
customer contact. Such feedback to an agent enhances learning and decreases 
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learning curve time, generally apparent with new agents. Ongoing analyses of 
agent/customer interactions are compiled in the high frequency data base 462. 
[0078] Wages earned by workers in geographic area 1 04 are lower than 
wages earned by workers in geographic area 102; thereby, creating geographic 
wage attenuation between the respective geographic areas. High frequency 
analysis of the agents' quality of service, provided to customer contacts, can be 
achieved while simultaneously increasing the business's profits. In one or more 
embodiments, a debit or a credit will be transferred in exchange for analysis 
services provided by the analysts. An example of a debit is an invoice or a bill to 
show what is owed and an example of a credit is payment in the form of valuable 
consideration. 

[0079] Within the figures presented in this detailed description of 
embodiments, separate paths have been used to depict the flow of customer 
interaction data and feedback from the analysis of these data for simplicity, no 
limitation is implied by this depiction. It will be realized by those of ordinary skill 
in the art that communication systems can support bidirectional communication 
over a single transmission line. Such bidirectional systems could be represented 
by a single line or path between points in a communications link, no limitation is 
implied thereby. 

[0080] In one embodiment. Figure 5 illustrates a flow diagram for 
interaction analysis corresponding to Figure 4 and generally depicts the process 
at 500. With reference to Figure 5, in one embodiment, transactions originate in 
the first geographic area 502; customers and agents can be located in 
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geographic areas other than 102, as described in conjunction with the previous 
figures. Analysts in the second geographic area 504 evaluate the transactions in 
near real-time to provide concurrent feedback to the agent. Calibration of the 
evaluation process is indicated by a calibration loop 506-508-510 to provide 
uniformity in scoring an agent's performance by conferencing the same agent's 
call to the team of analysts and reviewing the analysts' responses with the 
analysts (facilitated by an analyst supervisor or other facilitator) until the variation 
between the analysts' responses to the same agent's data is within acceptable 
limits. Acceptable calibration limits will be determined by the requirements of 
particular businesses; however, in one embodiment, a deviation of three percent 
(3%) between individual analyst's agent-scores Is one example of an acceptable 
level of quality. 

[0081] Even better feedback at 506, along with the transaction, scored at 
508, is provided to the agent in near real-time. Information from the analysts can 
be displayed directly on an agent's computer monitor such as computer 412, 422 
or 432. In one embodiment, near real-time results are sent to the business's 
contact center management at 512 as well as other levels of the business 
organization as are appropriate. Feedback Is received from the agent at 514, 
input on the analysts' reports and even better perfonnance suggestions are 
analyzed by the business and input is fed back to a recalibration process 518 
that ensures that the scoring 506 and 508 are in accordance with the goals of 
the particular business. Following this process, embodiments can be adapted 
and scaled to the needs and size of particular businesses. 
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[0082] In one or more embodiments, Figur 6 illustrates a flow diagram 
employing a high frequency data base, generally shown at 600. With reference 
to Figure 6, the high frequency data base representing the accumulation of data 
on agents' performance during contact center interactions is collected on a 
substantially continuing basis and is used by a business to guide the businesses 
future decisions with respect to hiring an agent for a particular job. At 602, an 
agent applies for a job with a particular business. The agent applicant takes a 
test at 604 to determine the prospective agent's suitability for the particular job. 
The agent is interviewed for the particular job at 606 and a decision to hire the 
agent is made at 608 based in part on the agent's application, interview, and the 
high frequency data base. The high frequency data base can be used to filter 
the application and interview elements based on agent characteristics that have 
been found to correlate with successful agent performance. For example, in one 
embodiment, it has been discovered that an agent's ability and propensity to up- 
sell during a sales call is increased if the agent personally participates in and 
uses the product that the customer is asking about. Therefore, in certain fields, 
the business will prefer to hire applicant's who have personal experience using 
products that the business is selling. 

[0083] Following hiring, training occurs at 610. Training times are also 
recorded In the high frequency data base and are also used to guide future hiring 
decisions. Process 612 can include an accelerated 4X monitoring phase that in 
one or more embodiments is useful to train agents in certain industries. For 
example, when a new seasonal line of clothing is introduced, it is advantageous 
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to enhance the feedback that agents receive by monitoring the agents' 
perfonnance six times a day (6X). In another embodiment, when a new 
promotional program is introduced, such as a new cruise line vacation package, 
4X training provides for a shorter learning curve for the agent which results in 
revenue improvement for the business. 

[0084] Figure 7 illustrates an example of increased profitability according 
to one embodiment of the invention. With reference to Figure 7, a single agent's 
contribution to increasing the profitability of a business is shown generally at 700. 
Single agent activity is shown in column 702. Existing agent performance 
without the improvements taught herein is shown in column 704. The enhanced 
agent perfonnance provided by the teachings according to one embodiment of 
the invention provides an increase in the agent's up-sell rate from 8.0% (704) to 
8.8% (706). This up-sell rate increase is applied to 4.96 up-sell transactions a 
day (704) increasing the number of up-sell transactions to 5.46 (706). Up-sell 
revenue is increased from $124.00 (704) to $150.04 (706). Subtracting these 
two numbers provides a revenue improvement of $26.04 as indicated at 710. A 
profit margin of 50% on the revenue improvement of $26.04 produces an 
Increased profit of $13.02 as indicated at 712. The average daily cost to the 
business for the analyst is $1.50 with a geographic wage attenuation of .2, 
resulting in a daily return on investment (ROI) of 768% as indicated at 716. 
[0085] It will be appreciated that the methods described in conjunction 
with the figures may be embodied in machine-executable instructions, e.g. 
software. Alternatively, some of the methods can involve the participation of an 
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operator with a general-purpose processor that is programmed with the 
instruction to perform the operation described. The instructions can be used to 
cause a general-purpose or special-purpose processor that is programmed with 
the instructions to perform the operations described. Alternatively, the 
operations might be perfonned by specific hardware components that contain 
hardwired logic for performing the operations, or by any combination of 
programmed computer components and custom hardware components. The 
methods may be provided as a computer program product that may include a 
machine-readable medium having stored thereon instructions which may be 
used to program a computer (or other electronic devices) to perform the 
methods. For the purposes of this specification, the terms "machine-readable 
medium" shall be taken to include any medium that Is capable of storing or 
encoding a sequence of instmctions for execution by the machine and that 
cause the machine to perform any one of the methodologies of the present 
invention. The term "machine-readable medium" shall, accordingly, be taken to 
include, but not be limited to, solid-state memories, optical and magnetic disks, 
and carrier wave signals. Furthermore, it Is common in the art to speak of 
software, in one form or another (e.g., program, procedure, process, application, 
module, logic...), as taking an action or causing a result. Such expressions are 
merely a shorthand way of saying that execution of the software by a computer 
causes the processor of the computer to perform an action or produce a result. 
[0086] As used in this description, "one embodiment," "one or more 
embodiments," "an embodiment" or similar phrases means that feature(s) being 
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described are included in at least one embodiment of the invention. References 
to "one embodiment" or any reference to an embodiment in tiiis description do 
not necessarily refer to the same embodiment; however, neither are such 
embodiments mutually exclusive. Nor does "one embodiment" imply that there is 
but a single embodiment of the invention. For example, a feature, structure, act, 
etc. described in "one embodiment" may also be included in other embodiments. 
Thus, the invention may include a variety of combinations and/or integrations of 
the embodiments described herein. Also, as used in this description, the terms 
Interaction" and "transaction" are synonymous. 
[0087] While the invention has been described in terms of several 
embodiments, those of ordinary skill In the art will recognize that the invention is 
not limited to the embodiments described, but can be practiced with modification 
and alteration within the spirit and scope of the appended claims. The 
description is thus to be regarded as illustrative instead of limiting. 
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